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Overview 


• Access tools and data through standard desktop computer, FBI 
Intranet, & a browser session 

• Interactive search services 

- Search based on free-form entered phrase 

- Search for subject terms such as name, DOB, SSN, telephone number 

- Search on metadata such as case number, document date, author, etc. 

- Capability to refine searches & set of search results 

• Batch search services - search for subject terms 

• More than 12,000 users - including Joint Terrorism Task Force 
(JTTF) members 

• Collection of 53 government multi-source datasets including data 
from FBI, CIA, DOS, DHS, FinCEN 

• Authority to Hold Data: 

- OGC and Privacy Impact Assessments (PIA) done for all data 

- Information Sharing Policy Board (ISPB) approves all data 

- Audit and Security Log Protocols are maintained across all dat 
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Background 

• Program started in FY02 

• Program goals in FY03 OMB 300 Exhibit 

- Data from 40 sources 

- 5,000 users 

- 1 00 - 200 M records 

- 3-5 second response time for interactive searches 

• Program achievements 

- Data from 53 sources 

- 12,432 user accounts 

- Data from - 500 M documents 

- 3-8 second median response time for interactive searches 

- Added Batch Search service 

- Special Project Team provided services to 5 task forces or operations 

• Authority to Operate through 2008 for Integration/Test & Operational 
Environments 

• Authority to Hold Data 

- OGC and Privacy Impact Assessments (PIA) done for all data 

- Information Sharing Policy Board (ISPB) approves all data 
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Growth in User Accounts 


12,432 total users as of 4/12/06 
All Field Offices & 23 Legal Attache Offices 


IDW USER ACCOUNTS 
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Users 


Breakdown of IDW Accounts 
Account DescriDtion 

No. of Accts as of 
02/22/2006 

Percent 

FBI Agent 

3,858 

32% 

FBI Analyst/Support 

3,044 

25% 

Federal Agency (Non-FBI) 

1,541 

13% 

State Agency 

313 

3% 

Local Agency 

975 

8% 

Other LE & Analyst users 

2,248 

19% 

Total 

11,979 

1 00% 
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IDW Unique Users per Week 

Between - 1 ,200 & - 1 ,600 unique users 
sign on in any given week 


IDW Unique Users 
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IDW-S Unique Users 
Total Unique Users 
Linear (IDW-S Unique Users) 


IDW-SPT Unique Users 
Linear (Total Unique Users) 
Linear (IDW-SPT Unique Users) 
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Interactive Transactions (Weekly) 

• Between ~ 40,000 & ~ 60,000 interactive 
transactions in any given week 


INTERACTIVE TRANSACTIONS 
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IDW-S Queries Processed 
DW-S Documents Viewed 
TOTAL IDW-S Transactions 
TOTAL TRANSACTIONS 


IDW-SPT Queries Processed 

IDW-SPT Documents Viewed 

TOTAL IDW-SPT T ransactions 
- Linear (TOTAL TRANSACTIONS) 
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Batch Processing 


• Between ~ 50 & ~ 1 50 batch jobs submitted 
in any given week 

BATCH PROCESSING 
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Batch Jobs Submitted — Batch T ransactions Processed 


Linear (Batch Jobs Submitted) Linear (Batch Transactions Processed) 
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Number of IDW Batch Jobs 
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7,642 Batch jobs were submitted 
between 05/25/2004 and 3/17/2006 
by a total of 891 different users 
for an average of 9 batch jobs per user. 




ieconds 


Interactive Search Response Times (Weekl 


Average response time - 8 to 1 2 secs, 
Median response time - 3-8 secs 

RESPONSE TIMES 
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Composition of Data 




Document Source 

No. of Docs as of 03/17/2006 

Percent 

FBI Sources 

164,271,091 

28% 

Non-FBI Sources 

.... 

422,915,362 

72% 

Total 

587,186,453 

1 00% 


Document Tvoe 

No. of Docs as of 03/1 7/2006 

Percent 

Structured 

542,939,167 

92% 

Un-Structured 

44,247,286 

8% 

Total 

587,186,453 

1 00% 
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Case References to IDW Services 

• 23,759 references to IDW in ACS/ECF as of 
3/17/2006 

- 87% referred to NSB related Case Classifications 

- References to IDW in FCI cases increasing 

- IDW contains only limited case data from Cyber, Civil 
Rights and Public Corruption 

- CID requests for IDW accounts has increased 
dramatically in last 2 months 

• Sample of batch service job titles 

- Vetting for special events 

- Specific investigations 

- Threat assessments 
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Areas for Improvement 

• Need capability for continuous operation 
given loss of primary site or capability at 
primary site 

• Additional resources needed to meet for 
projected growth in number of users and 
volume of data 

• Need more robust (responsiveness and 
capacity) backup and restore capability 

• Need more robust test capability 
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Status 

• Core capability completed 

- Interactive search 

- Batch search 

- Monitor & control capability to manage Quality-of-Service 

• Improving service 

- Optimizing capacity & responsiveness given resource 
constraints 

- Transitioning to Extraction/T ransformation/Load service 

• Demand for service growing beyond expectations & 
base resources 

- Host more data (4x-8x current 4 TB) 

- Provide service to more users (~ 20K) 

- Provide continuous monitoring for updates 

- Provide geo-coded data 

- Integrate with emerging Enterprise services 
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Conclusion 


• IDW has managed growth in users & data while 
maintaining Quality-of-Service 

• IDW users are obtaining operational utility from 
the services provided by IDW 

• Additional resources needed to meet greater 
than anticipated demand for services 

• IDW services should be enhanced to provide 
data-related services 

- Provide services to reduce effort of integration & data 
migration 

- Provide functions needed to manage data quality 
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